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Suppose that a coin with bias 9 is tossed at renewal times of a 
renewal process, and a fair coin is tossed at all other times. Let fig 
be the distribution of the observed sequence of coin tosses, and let Un 
denote the chance of a renewal at time n. Harris and Keane in [10] 
showed that if ^^j^ = oo, then /19 and /xq are singular, while if 
< ^ small enough, then fig is absolutely continuous 

with respect to fiQ. They conjectured that absolute continuity should 
not depend on 9, but only on the square-summability of {un}. We show 
that in fact the power law governing the decay of {un} is crucial, and 
for some renewal sequences {un}, there is a phase transition at a critical 
parameter 9c £ (0, 1): for \9\ < 9c the measures fig and fio are mutually 
absolutely continuous, but for \9\ > 9c, they are singular. We also prove 
that when u„ = 0{n~^), the measures /ig for 9 E [—1, 1] are all mutually 
absolutely continuous. 

1. Introduction. A coin toss with bias 6 is a {—1, l}-valued random vari- 
able with mean 9, and a fair coin is a coin toss with mean zero. Kak;utani's 
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dichotomy for independent sequences reduces, in the case of coin tosses, to the 
following: 

Theorem A ([13]) Let he the distribution of i.i.d. fair coin tosses on 
{—1,1}'^, and let vq be the distribution of independent coin tosses with biases 



(i) IfJ2'^=i = °° ^^^'^ -L MO; where u ± ^ means that the measures v and 

jjL are mutually singular. 

(ii) < t^^''^ Mo o,nd /Uq <C ve, where z/ <C /U means that v is 
absolutely continuous with respect to fj,. 

For a proof of Theorem A see, for example. Theorem 4.3.5 of [7]. 

Harris and Keane [10] extended Theorem A(i) to sequences with a specific 
type of dependence. Let {r„} be a (hidden) recurrent Markov chain with initial 
state o, called the origin. Suppose that whenever r„ = o, an independent coin 
with bias ^ > is tossed, while at all other times an independent fair coin is 
tossed. Write X = {Xi,X2, . . .) for the record of coin tosses, and let fie be the 
distribution of X. Let A„ — l|r„=o} and denote by 



the probability of a return of the chain to the origin at time n. The random 
variables {A„} form a renewal process, and their joint distribution is determined 
by the corresponding renewal sequence see the next section. Harris and 

Keane established the following theorem. 



n=l- 



oo 



Un = P[r„ = O] = P[A„ = 1] 



Theorem B ([10]) 




= oo, then fie -L no- 
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(^^) If Sj^i = II ^ II ^ < 00 and < \u \ ~^ , then ne <C Mo- 
Harris and Keane conjectured that singularity of the two laws ^ig and should 
not depend on 6, but only on the return probabilities {tin}. In particular, they 
asked whether the condition X^^o^fe < °° implies that /ig <C /Uq, analogously 
to the independent case treated in Theorem A. We answer this negatively in 
Sections 4 and 5, where the following is proved. 

Notation: Write a„ x 6„ to mean that there exist positive finite constants C\ , C2 
so that Ci < an/bn < C2 for all n > 1. 

Theorem 1.1. Let 1/2 < 7 < 1. Suppose that the return probabilities 
satisfy Un ^ n~^ and max{wj : « > 1} > 2''~^. 

(ii) The bias can be a.s. reconstructed from the coin tosses {Xn}, provided 9 
is large enough. More precisely, we exhibit a measurable function g so that, 
for all 9 > max{i^ i>i} — 1) we have 9 = g{X) 110 -almost surely. 

Part (i) is proved, in a stronger form, in Proposition 4.1, and (ii) is contained in 
Theorem 5.1 in Section 5, where g is defined. 

In Section 4 we provide examples of random walks having return probabilities 
satisfying the hypotheses of Theorem 1.1. We provide other examples of Markov 
chains in this category in Section 8. 

For this class of examples, Theorem B(ii) and Theorem 1.1 (i) imply that there 
is a phase transition in 9: there is a critical 9c G (0, 1) so that for 9 < 9,., the 
measures and /xq are equivalent, while for 6 > 9c, ^le and /Uq are mutually 
singular. See Section 3 for details. Consequently, there are cases of absolute 
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continuity, where altering the underlying Markov chain by introducing delays 
can produce singularity. 

Most of our current knowledge on the critical parameter 

9c =^ sup{6' : 1X0 < /xo} 

is summarized in the following table. Choose r such that Ur = max{ui : i > 1}, 
and let 6s = (X^^i u\)~^/'^ A 1. (The arguments of Harris and Keane [10] imply 
that 9s is the critical parameter for /x^i to have a square-integrable density with 
respect to /Uq.) 



cisymptotics of m„ 


critical parameters 


Un X n^'^ , i < 7 < 1 
Un = 0{n~^) 


Q = 9s = ec 

0<9s<9c< u-^Tf - 1 
Q<9s<dc = \ 



There are renewal sequences corresponding to the last row for which < 0^ < 
= 1; see Theorem 1.4 and the remark following it. 

Theorem l.l(ii) shows that for certain chains satisfying X^^g'^n < ^o^" ^ 
large enough, the bias 9 of the coin can be reconstructed from the observations 
X. Harris and Keane described how this can be done for all 9 in the case where 
r is the simple random walk on the integers, and asked whether it is possible 
whenever = oo. In Section 6 we answer affirmatively, and prove the 

following theorem: 

Theorem 1.2. IfJ2n ~ ^'^^^ there is a measurable function h so that 
9 = h{X) ne-a.s. for all 9. 

In fact, his a. limit of linear estimators (see the proof given in Section 6). Theorem 
1.2 is extended in Theorem 6.1. 
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There are examples of renewal sequences with < oo which do not 

exhibit a phase transition: 

Theorem 1.3. // the return probabilities {w„} satisfy Un = 0{n~^), then 
fJ-e /xo for allO <6 < 1 . 

For example, the return probabilities of (even a delayed) random walk on Z'^ 
have Ufe x k~^. 

Remark: The significance of this result is that the asymptotic conditions on 
still holds if the underlying Markov chain is altered to increase the transition 

probability from the origin to itself. 

This result is proved in Section 9. It is much easier to prove that ^0 and /zq 
are always mutually absolutely continuous in the case where the Markov chain 
is "almost transient", for example if Uk (fclogfc)"^. We include the argument 
for this case as a warm-up to Theorem 1.3. In particular, we prove the following 
theorem: 

Theorem 1.4. // the return probabilities satisfy Uk = 0{k~^), and 
obey the condition 

^ Vloglogny ' 

then jig <^ Ho for allO < 6 <1. 

Theorem 1.4 is extended in Theorem 8.2 in Section 8, and Proposition 8.5 
provides examples of Markov chains satisfying the hypotheses. Then Theorem 
1.3 is proved in Section 9. 

Write J = J2^=o -'-{r„=o}l{r;,=o}) where F and F' are two independent copies 
of the underlying Markov chain. The key to the proof by Harris and Keane of 
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Theorem B(ii) is the imphcation 

E[(l + e'^y] < oo ^ Ate < Mo • 

To prove Theorem 1.3 and Theorem 1.4 we refine this and show that 

E[(l + ey I r] < 00 ^ Me < Mo • 

The model discussed here can be generalized by substituting real-valued ran- 
dom variables for the coin tosses. We consider the model where observations are 
generated with distribution a at times when the chain is away from o, and a 
distribution t] is used when the chain visits o. 

Similar problems of "random walks on scenery" were considered by Benjamini 
and Kesten in [3] and by Howard in [11, 12]. Vertices of a graph are assigned 
colors, and a viewer, provided only with the sequence of colors visited by a 
random walk on the graph, is asked to distinguish (or reconstruct) the coloring 
of the graph. 

The rest of this paper is organized as follows. In Section 2, we provide defi- 
nitions and introduce notation. In Section 3, we prove a useful general zero-one 
law, to show that singularity and absolute continuity of the measures are the 
only possibilities. In Section 4, Theorem 1.1 (i) is proved, while Theorem 1.1 (ii) 
is established in Section 5. We prove a more general version of Theorem 1.2 in 
Section 6. In Section 7, wc prove a criterion for absolute continuity, which is used 
to prove Theorem 1.4 in Section 8 and Theorem 1.3 in Section 9. A connection 
to long-range percolation and some unsolved problems are described in Section 
10. 

2. Definitions. Let T = {0, 1}°° be the space of binary sequences. Denote 
by An the n*'' coordinate projection from T. Endow T with the ct- field H gen- 
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erated by {A}„>o and let P be a renewal measure on (T, TC), that is, a measure 
obeying 

rn 

(2.1) P[Ao = l,A„(i) = 1,...,A„(„) = 1] = 

i=l 

where =^P[A„ = 1]. We let {Tfe}^^ denote the inter-arrival times of the 
renewal process: If Sn = inf{m > 5„_i : A^ = 1} is the time of the n*'' renewal, 
then Tn = Sn — Sn-i- The condition (2.1) implies that Ti,T2, . . . is an i.i.d. 
sequence. We will use /„ to denote P[ri = n]. 

In the introduction we defined u„ as the probability for a Markov chain F to 
return to its initial state at time n. If A„ = l{r„=o}) then the Markov property 
guarantees that (2.1) is satisfied. Conversely, any renewal process A can be real- 
ized as the indicator of return times of a Markov chain to its initial state. (Take, 
for example, the chain whose value at epoch n is the time until the next renewal, 
and consider returns to 0.) Thus we can move freely between these points of 
view. For background on renewal theory, see [8] or [15]. 

Suppose that a, r/ are two probabilities on R which are mutually absolutely 
continuous, that is, they share the same null sets. In the coin tossing case dis- 
cussed in the Introduction, these measures are supported on { — 1,1}. Given a 
renewal process, independently generate observations according to r] at renewal 
times, and according to a at all other times. We describe the distribution of these 
observations for various choices of r]. 

Let R°° denote the space of real sequences, endowed with the cr-field Q gener- 
ated by coordinate projections. Write ri°° for the product probability on (R°^, G) 
with marginal rj. Let be the measure a°° x 77°° x P on (R°° x R°° x T, ^ (g) ^ (g) 
H). In the case where 77 is the coin tossing measure with bias 6, write Q^i for Q^. 
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The random variables Yn,Zn are defined by Yn{y,z,5) = yn, Zn{y,z,S) = Zn- 
Finally, the random variables X„ are defined by 

— 0- ~ + AnZn. 

The distribution of X = {X^} on R°° under will be denoted /x^. 

The natural questions in this setting are: if f3 and w are two mutually ab- 
solutely continuous measures on R, under what conditions is /.ip _L /i^r? Under 
what conditions is fijs <?C /x^? When can r] be reconstructed from the observa- 
tions {Xn} generated under /x^? Partial answers are provided in Proposition 4.1, 
Theorem 1.1, Theorem 5.1, Theorem 6.1, and Theorem 8.2. 

3. A Zero-One Law and Monotonicity. We use the notation established 
in the previous section. Let Qn be the cr-field on R°° generated by the first n 

coordinates. If /i^g and fi^ are both restricted to Qn, then they are mutually 
absolutely continuous, and we can define the Radon-Nikodym derivative p„ = 
S^ISn- Write p for liminf„^oo Pn; the Lebesgue Decomposition Theorem (see 
Theorem 4.3.3 in [7]) implies that for any AgQ, 

(3.2) n^[A] = I pdn0 + Mr"'?(^) = / pdfii3 + pA{p = oo}nA], 

J A J A 

where p,^""^ _L pp. Thus to prove that p„ pp, it is enough to show that 

(3.3) 1 = p„[x : p{x) < oo] = Q„[p{X) < oo]. 

For any process T, let e^r = (r„,r„+i, . . .), and let T{T) = 0^^=! (^(©nF) be 
the tail a-field. 

Lemma 3.1 Zero - One Law. The tail a-fieldT{Y, Z, A), and hence T{X), 
is Qri-trivial. That is, AeT{Y, Z, A) implies Qr,{A) e {0, 1}. 
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Proof. By the Kolmogorov Zero-One Law, T{Y) and T{Z) are trivial. The 
inter-arrival times {T„} form an i.i.d. sequence, and clearly T( A) c £{Ti,T2, . . .), 
where £ is the exchangeable cr-field. The Hewitt-Savage Zero-One law implies 
that £, and hence T{A), is trivial. 

Let / be a bounded T(Y, Z, A)-measurable function on R°° x R°° x T which 
can be written as 

(3.4) fiy,z,S)^My)h{z)MS). 

By independence of Y,Z, and A, and triviality of T{Y),T{Z), and T(A), it 
follows that 

E[/i(y)/2(Z)/3(A)] = E/i(F)E/2(Z)E/3(A) = h{Y)f2{Z)MA) a.s. 
Consequently, for all functions of the form (3.4), 

(3.5) E/(F,Z,A) = /(F,Z,A)a.s. 

The set of bounded functions of the form (3.4) is closed under multiplication, 
includes the indicator functions of rectangles A x B x C ior A,B e H and 
C €:Q, and these rectangles generate the a-field Q x Q xH. Since the collection 
of bounded functions satisfying (3.5) form a monotone vector space, a Monotone 
Class Theorem implies that all bounded Q x Q x 7i-measurable functions obey 
(3.5). We conclude that T {Y, Z, A) is trivial. □ 

Proposition 3.2. Either and jifs are mutually absolutely continuous, or 

Proof. Suppose that ixt^ / fifj. From (3.2), it must be that p < oo with positive 
H„ probability. Because the event {p < oo} is in T, Lemma 3.1 implies p < oo 
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/iTT-almost surely. Using (3.2) again, we have that /Ltjr <C /Lt/3. The same argument 
with the roles of /3 and tt reversed, yields that ji^ <C also. □ 
We return to the special case of coin tossing here, and justiiy our remarks in 
the introduction that for certain sequences {w„}, there is a phase transition. In 
particular, we need the following monotonicity result. 

Proposition 3.3. Let 61 < 02- 1} l^e^ -L Mo, then jig^ _L ^o- 

Proof. Couple together the processes X for all 9: At each epoch n, generate a 
variable Vm uniformly distributed on [0, 1). If A is a renewal process independent 
of {Vn}, define by 



(3.6) Xi 



-1 if Vn < 



1 + 9A„ 



-li{Vn>^ 

Then X^^ < X^^ for 6*1 < 6*2, and X^ has law ^ug for all 6 e [0, 1]. Thus 
stochastically dominates iJei ■ 

Suppose now that _L /xq- Then (3.2) implies that 

(3.7) A*6»i[P0i = 00] = 1 and /(Xo[P6»i = 0] = 1. 
Because the functions 

/n 
n(i+fefeAfe)dP(A) 
- k=0 

are increasing in x, it follows that p is an increasing function and the event 
{p = 00} is an increasing event. Because pe^ stochastically dominates pe^, we 
have 

(3.8) p0^[p0^ = 00] = 1. 
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Putting together (3.8) and the second part of (3.7) shows that we have decom- 
posed R°° into the two disjoint sets {po^ = 0} and {pe^ = oo} which satisfy 

PoIpOi = 0] = 1 and peiiPBi = oo] = 1 . 

In other words, -L Mo- 1^ 
Consequently, it makes sense to define for a given renewal sequence the 
critical bias 9c by 

6c ^= sup{9 < 1 : Me < Mo}- 

We say there is a phase transition if < < 1- The results of Harris and Keane 
say ^ = 00 implies = 1 and there is no phase transition. In Section 4, we 
provide examples of {m„} with ^„ < oo having a phase transition. In Section 
8, we provide examples with < oo without a phase transition. 

4. Existence of Phase Transition. In this section, wc confine our atten- 
tion to the coin tossing situation discussed in the Introduction. In this case, a 
and /? are both the probability on {—1,1} with zero mean, and tt is the proba- 
bility with mean 6 (the ^-biased coin). The distributions M/3 and Mtt are denoted 
by Mo and Me respectively. Let J7„ =^ J2k=o "fc- 

Proposition 4.1. Let {un} be a renewal sequence with 

n 

= Un ^ n^~T^(n), 

k=0 

for 5 < 7 < 1 and £ a slowly varying function. If 

(1 -I- 61) max{ui : i > 1} > 2^, 

then Me -L Mo- 
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Remark. The conditions on 9 specified in the statement above are not vacuous. 
That is, there are examples where the lower bound on 6 is less than 1. There are 
random walks with return times obeying >; , as shown in Theorem 4.3. 
By introducing delays at the origin, ui can be made to be close to 1, so that 

Proof. Let E denote expectation with respect to the renewal measure P and 
let Eg denote expectation with respect to Q^i. Let Ur = maxjuj : i > 1} and 
assume for now that r = 1. Let b= ^(1 + ^) and k{n) = [(1 + e) log2 nj , where e 
is small enough that (1 + e)(— log2 uib) < 1 — 7. Define A" as the event that at 
all times i G [jk{n), {j + l)k{n)) there are renewals and the coin lands "heads", 



Note that we have defined things so that c(n) >: n p, where p < 1 — 7. Then 



I.e. 




Let Z?/=i' lAn,and 

c(n) Q,[A5'|A,fc(„) = 1] = 



n/k{n) 



n/fc(n) 



(4.9) 




We need the following simple lemma: 



Lemma 4.2. For all r >0, 



(4.10) 



Ur + Ur+k H h Ur+mk < Uq + Uk -\ h Umk ■ 



Proof. Recall that uo = 1. Let r* = inf{j > : Ar+jk = !}• Then 



m 




3=0 



<Uo + Uk + ■■ ■ + Umk ■ 
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Taking expectation proves the lemma. □ 
By this lemma, 



n/k{n) „ 

Ui 



and thus 

Combining (4.9) and (4.12), we find that 

Since 1 — 7 — p>0, it follows that E^Dn ^ 00. 
Also, 

n/kin) n/k{n)n/k{n) 

i=l i—1 j=i-\-l 

n/k(n) 7i/k(n) 

= 'EeDn + 2 ^ ^ c(n)ufe(„)(j_i_i)+ic(n)Mfc(„)i 

i=l j=i+l 

n/k(n) n/k{n) 

< EeDn + 2c{nf ^ ^ Uk(^n)j+i 

i=l j=0 
n/k{n) n/k{n) 

(4.13) <E,D„ + 2c(n)2 ^ «fe(„), ^ 

i=l j=0 

n/kin) n/kin) 

(4.14) < EeL'„ + 2c(n)2 ^ ^ + 2uoc(n)Ee£'„ 

i=i j=i 

/n/kin) \ 2 

''^kin)i + 2ltoc(n)E0D„ 

(4.15) < (7(EsD„)2 

(4.13) follows from Lemma 4.2, and the last term in (4.14) comes from the 
contributions when j = 0. 
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If An is the event that there is a run of length k{n) after epoch k{n) and 
before n, then (4.15) and the second moment inequality yield 

Qo[An] > Qe[Dn > 0] > ^ ^ > 0. 

Finally, we have 

Qe [lim sup > lim sup Qe > 0, 

and by the Zero-One Law (Lemma 3.1) we have that Q6i [lim sup = 1. A 
theorem of ErdHos and Renyi (see, for example. Theorem 7.1 in [21]) states that 
under the measure /zq, -L„/log2n — > 1, where i„ is the length of the longest 
run before epoch n. But under the measure fxg, we have just seen that we are 
guaranteed to, infinitely often, see a run of length (1 + e) log2 n before time n. 

If ui ^ max{ui : i > 1}, consider the renewal process {A„r}^o ^^'^ 
the sequence {X„r}^o> where Ur = max{uj : i > 1}. Apply the proceeding 
argument to this subsequence to distinguish between /xg and fio- ^ 

Proposition 4.3. There exists a renewal measure P with Un ~ Cn~'' for 
1/2<7<1. 

Proof. For a distribution function F to be in the domain of attraction of a 
stable law, only the asymptotic behavior of the tails F{t), 1 — F{—t) is relevant 
(see, for example, Theorem 8.3.1 in [4]). Thus if the symmetric stable law with 
exponent I/7 is discretized so that it is supported on Z, then the modified law 
F is in the domain of attraction of this stable law. Then if F is the random walk 
with increments distributed according to F, Gnedenko's Local Limit Theorem 
(see Theorem 8.4.1. of [4]) implies that 

lim |n^P[r„ = 0]-<7(0)| = 0, 
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def 

where g is the density of the stable law. Thus if A„ = l{r„=o}) then {A„} form 
a renewal sequence with ~ Cn~^ . □ 

For a sequence to satisfy the hypotheses of Proposition 4.1 and 1.1, we also 
need that max{uj : i>l}> 2'^~^. By introducing a delay at the origin for the 
random walk V in Proposition 4.3, ui can be made arbitrarily close to 1. Thus 
there do exist Markov chains which have < < 1- 

An example of a Markov chain with J7„ x n^/^ will be constructed by another 
method in Section 8. 

5. Determining the bias 6. In this section we refine the results of the 
previous section and give conditions that allow reconstruction of the bias from 

the observations. 
For a > 1, let 

(5.16) A*(a) hm - log^ P[Tr + -•+ < ma] _ 

m— >cxD m 

(A* (a) = cx) for a < 1 (since each Tj > 1), hence we restrict attention to when 
a > 1.) 

Because ETj = oo, Cramer's Theorem (see, e.g., [6]) implies that A* (a) > 
for all a. Since lima|ooP[T'i < a] = 1, it follows that lima|oo A*(a) = 0. Also, 

A*(l) = -l0g2 Ml. 

It is convenient to reparameterize so that we keep track of <^ =^ log2(l + 0) 
instead of 6 itself. Let 

(5.17) V^(^,0=^(¥'-A*(^'))andV(^)1^'■ su^ ^{^,0- 

0<«<1 

Observe that lim|^o V'(v> = 0- For e > small enough so that A*(e~^) < ^, 
V^(^,e)>e(^-|)=e|>0. 
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Hence, The maximum of 'tp{(p, •) over (0, 1] is attained, so we can define 

Co{^) inf{0 < e < 1 : V^(<^,0 = V(^)} • 

We show now that i^ifj^o) > i^i'fiA)^ a fact which we will use later (see the 
remarks following Theorem 5.1). Let £ = min{n > 1 : /„ > 0}, and note that 
/i = Ui. If in the interval [0, k{l + [ei\)] there are k — [efcj inter-renewal times 
of length 1 and [efcj inter-renewal times of length £, then in particular there are 

at least k renewals. Consequently, 

(5.18) P[T, + ...+Tk<k{l + et)] > ^^^^ ^ ft ^^'^ ft^ 
Taking logs, normalizing by k, and then letting A; — > oo yields 

-A*(l + el) = lim fc"^ loga P[Ti + ---+Tk<k{l + ei)] 
> /12(e) + log2 /i + elog2(/<!//i) , 
where /12(e) = elog2 e~^ -|- (1 — e) log2(l — e)~^. Therefore 

(5.19) ^{^, ^) - V(</^, 1) = - + log2 /i 

(5.20) > ^ {-eify + \ogMh)) + M^)} 

Thus for e bounded above, the left-hand side of (5.19) is bounded below by 
Ci (/12(e) — C2e). Since the derivative of /i2 tends to infinity near 0, there is a 
positive e where the difference is strictly positive. Thus, the maximum of V'(</?, •) 
is not attained at ^ = 1. 

Finally, tf) is strictly increasing: let < ip' , and observe that 

Theorem 5.1. Recall that 

P[Xk = 1 I Afc = 1] = 2-1(1 + 6) = 2^-\ for^":^' log2(l + 6) . 
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Let 

Rn = sup{m : Xn+i = ■ ■ ■ = X^+n = 1} O'lT-d' = linisupi?„(log2 n)~^ . 

n 

Suppose that 5 < 7 < 1 and £ is a slowly varying function. If Un x n^~^£{n), 
then 

where ip is the strictly monotone function defined in (5.17). 

In particular, for (p > ^""^(7) (equivalently, 9 >2'^ ^^'^^ — 1), we can recover 
ip (and hence 6) from X: 

--'('-^)- 

Remark. Suppose ui — max{ui : i > 1}. Since ip^ip) > ip{ip,l), (see the 
comments before the statement of Theorem 5.1) we have that 

(5.21) tp{(fi) > (/3 + log2Ui . 
Substituting tp~^{l) ip in (5.21) yields 

V'"^(7) < 7-log2Wi- 

Thus 

(5.22) 2^"'^^) - 1 < 2T-'°S2«i_i. 

The right-hand side of (5.22) is the upper bound on 9c obtained in Proposition 
4.1, while the left-hand side is the upper bound given by Theorem 5.1. Thus this 
section strictly improves the results achieved in the previous section. 
Proof. Let C = (1 - 7)/(l - ipif))- We begin by proving that R{X) < C V 1, or 
equivalently, that 

(5.23) Vc> C V 1, Qe[R„ > clogjn i. o. ] = 0. 
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def 

Fix c > C V 1. If k{n, c) = k(n) = |_clog2 nj , then it is enough to show that 

(5.24) Q0[limsup{X„+i = • • • = X„+fc(„) = 1}] = 0. 

n 

Let En be the event {Xn+i = ■ ■ ■ = Xn+k{n) = 1}) and define 
F„ =^ inf{m > : A„+„ = 1} 

as the waiting time at n until the next renewal (the residual lifetime at n). We 
have 

fe(ri) 

(5.25) Qe[En] < Qe[En \ > k{n)] + ^ Qe[£„ | = m]Qe[Fn = m]. 

m—l 

Notice that 

{Fn =m} = {A„+i = • • • = An+m-l = 0, A„+„ = 1}, 
and consequently we have 

Qe[En \Fn = m, An+m+l, ■ ■ ■ , 

(5.26) 

_ 2-'=(")(l -)- ^)l+^n+m+lH \-^n+k(n) 

Taking expectations over {An+m+i, • • • ) A^+kin)) in (5.26) gives that 
Qe[En \Fn=m] = 2-'=(")E[(1 + ^)i+An+„.+i+-+A„+,(„) | ^^^^ ^ 

(5.27) = 2-'=(")E[(1 + 6»)i+Ai+-+A.(„,_„j 

The equality in (5.27) follows from the renewal property, and clearly the right- 
hand side of (5.27) is maximized when m = 1. Therefore the right-hand side of 
(5.25) is bounded above by 

(5.28) 2-'=(") + {Un+kin) - Un)Q0[En \ A„+i = 1]. 

We now examine the probability Qe[En \ A„+i = 1] appearing on the right- 
hand side of (5.28). Let N[i,j] =^ J2k=i be the number of renewals appearing 



Random Coin Tossing 19 
between times i and j. In the following, N = N[n + 1, n + k{n)]. We have 

QeK I A„+i = 1] = 2-'=(")e[(i + ef I A„+i = 1] 

(5.29) = E[2'=(")(-i+*'^/'=(")) I A„+i = 1] . 

By conditioning on the possible values of A'', (5.29) is bounded by 

k(n) 

(5.30) 2'=(")(-i+^'"/'=("»P[Ti + • • • T„ < k{n)] . 

m=l 

By the superadditivity of logP[Ti + • • ■ + Tm < ma], the probabilities in the sum 
in (5.30) are bounded above by 2-™^* ('=(")/"'). Consequently, (5.30) is dominated 
by 

k(n) k{7i) 

2k{n){-l-\-m/k{n){(^-A*{k{n)/m))) ^ 2'^C^)(-l+^('v^'^/^("))) 

m=l m=l 

< fc(n)2'=(")('^(*')-i) 

Hence, returning to (5.28), 

Qe[En] < 2-'=(") + ([/„+,(„) - [/„)fc(n)2-'=(")(i-'^(^)) 

(5.31) < 2n-^ + 2fc(n)(C/„+fe(„) - C7„)n-'^(i-'^('^)). 

Let q = c(l — ipif)), and since c > C V 1, we have that 5 + 7 > 1. Letting 

m{n) = n + k{n), since m(n) > n, we have 

L L 

^ fc(n)?7„+fe(„)n"« < ^ A;(m(n))f/„(„)(m(n) - A;(n))"« 

n=l n=l 



< ^ fc(m(n))C/„(„)(m(n) - fc(m(n)))" 



n=l 



L+fc(L) 

(5.32) < k{m)Um{m - k{m)y 

m=l 



20 



D.A. Levin, R. Pemantle, and Y. Peres 



Then, using (5.32), it follows that 



L L 



E Kn){Un+kin) - Un)n-'i < ^ k{n)Un ((n - k{n))-i 



— n 




L+k{L) 



(5.33) 



n=L+l 



Since a"? < C(6-a)a-i-«, and J7„ < Cn^"'^, the right-hand side of (5.33) 

is bounded above by 



We have that (5.34), and hence (5.33), is bounded above by 

L 

(5.35) Ca k{nfn-^i+''^ + o(l) . 

Since q + -y > 1, (5.35) is bounded as L ^ oo. Wc conclude that (5.31) is 
summable. Applying the Borel-Cantelli lemma establishes (5.24). 
We now prove the lower bound, R{X) > C V 1. 

It is convenient to couple together monotonically the processes for different 
6. See (3.6) in the proof of Proposition 3.3 for the construction of the coupling, 
and let {Vi} be the i.i.d. uniform random variables used in the construction. 

First, using the coupling, we have that R{X^) > R{X^) = 1. Hence, 



(5.34) 



'''k{n){n ~ k{n)) 



-g-l 



+ C2k{L)k{L + k{L)){L + k{L)) 



^-^{L-k{L))-i 



^J,e[x : R{x) > 1] = 1. 



It is enough to show that if c < then 



Qe[-Rn > fc(c,n) i. o.] = l. 



Fix and write for ^o(<^)- 
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Let Ti = r" be the time of the [^ok{n)}*'^ renewal after time ik{n) — 1. The 
event Gf of a good run in the block 7" = [ik{n), {i + l)k{n) — 1] n Z+ occurs 
when 

1. there is a renewal at time ik{n): Aj^;(„) = 1, 

2. there are at least ^ok{n) renewals in 1^: Ti < (i + l)fc(n) — 1, 

3. until time Tj, all observations are "heads": Xj = Ifor ik{n) < j < Ti, 

4. Vj < 1/2 for Ti<j<{i+ l)fc(n) - 1. 

The importance of the coupling and the last condition is that a good run in /j 
implies an observed run {Xj = IVj S /j). 

Let Ni = N[Ii]. The probability of is given by 

(5.36) Qe[G^] = 2-'=(")(l + 

where pi'^P[Ni > ^ok{n) \ Ai^^) = 1] is the probability of at least ^ok{n) 
renewals in the interval li, given that there is a renewal at ik{n). Note that 
Pi = pi for all i, by the renewal property. 

Following the proof of Proposition 4.1, we define -D„ = X^^^^^"^ Icr", and 
compute the first and second moments of Z)„. Using (5.36) gives 

n/k(n) 

(5.37) E,[I)„] = 2-'=(")(l+^)«°'=(")pi Yl ""Mn)- 

Since c < C = i ^^^o have for some e > that 

1 - -7 

(5.38) c < ' 



1 + e^o - i^i^) ■ 

By definition of A*, we can bound below the probability pi: For n sufficiently 
large, 

Pi ='P[Ni> ^ok{n) I Afc(„) = 1] 



22 D.A. Levin, R. Pemantle, and Y. Peres 

= P[Ti + ... + r5„fc(„) < A;(n)] 

(5.39) > 2~^''''("^(^*(^o '^+^) , 

where e > is arbitrary. Thus, plugging (5.39) into (5.37) shows that for n 
sufficiently large, 

n/k{n) 

Ee [£»„]> 2-'=(")(l+6')«'''=(")2-«°'=(")(^*(«o"')+'^) ujk(n) 

n/A;(n) 

^ 2fe(n)(-l-.Co+v.«o-«oA*(C„-^)) ^ ^.^^^^ 
n/k{n) 

(5.40) > , 

where q = (1 + e^o - V'(<^))c. By (5.38), 1 - 7 - <? > 0. Using (4.12), 

~,n/k{n) ^ i(n) 



j2^Mn) u.^^^^ ^ |fey"^ in (5-40), gives that for n large enough. 



E,[D„]>C3^ni---«"^oo. 

We turn now to the second moment, which we show is bounded by a multiple 
of the square of the first moment. 

n/k{n) n/k{n) 

(5.41) Ee[Dl]=2Y^ ^ t^" ^ ^."1 + I^"] • 

i=l 

We compute the probabilities appearing in the sum by first conditioning on the 
renewal process: 

Qe[G^ n G] I A] = (2-'=W(l + e)«oMn))' l{Ar,>£oMn), a..(„,=i} 

(5.42) X l{jv,>Cofc(«), A,j,(„)=i} • 

Taking expectations of (5.42), if d{n) = 2-'=(")(l + 6l)«o'=("), then 
Qe[G'l n G]] = d{nfP[Nj > ^oHn), ^Mn) = 1 and > ^ok{n) , A.^in) = 1] 
= d{nfpiP[Ajk{n) = 1 I A^i > ^ofc(«), Aife(„) = l]piUik(n) 
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(5.43) = d{nfpluik{n)P[^jk{n) = 1 | iVi > Cok{n) , ^ik{n) = 1] 
Summing (5.43) over i < j shows that ^1=^^"' Qe[Gf D GJ'] equals 

n/k{n) n/k{n) 

(5.44) d(n)2pf Yl ^Mn) Yl ^i^Mn) = 1 I > ^ofc(n), Aifc(„) = 1] . 
Let a = l)k{n) — ti. For m = n/k{n)^ write 

m 

(5.45) ^ P[A,fe(n) = 1 I A^i > eofc(n), Aife(„) = 1, a] 
as 

m 

(5.46) E[ ^ ^jk(n) \Ti<{i+ l)fc(n) , a] . 

j=i+i 

Then observe that (5.46) is bounded above by 

(5-47) U„ + U^+k(n) H 1- W<7+mfe(m) • 

We can apply Lemma 4.2 to bound (5.47) above by Xijlo ^ifc(n) ■ ^o summarize, 

m m 

(5.48) Yl = 1 I > CoA;(n), Aifc(„) = 1,(7] < • 

j=0 

Taking expectation over a in (5.48), and then plugging into (5.44) shows that 

n I k{n) n I k{n) n/k{n) n/k{n) 

E E Qe[G7nG]]<dinfpl E E "j^W 

i=l j=i-\-l i=l j=0 

(5.49) < (EeDnf + uo^eDn , 

where we have used the expression (5.37) for EgDn- Finally, using (5.49) in (5.41) 
yields that 

Eo[Dl] < C3(E,[D„])2. 
Now, we have, as in the proof of Proposition 4.1, that 

Q0[limsup{£)„ > 0}] > limsupQe[£)„ > 0] > C^^ > 0. 
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Using Lemma 3.1 shows that Q6)[hmsup{D„ > 0}] = 1. That is, the events 
yn/fc(n) Qn happen infinitely often. But since a good run is also an observed run, 
also the events 

1 < J < n/k{n) with Rjk{n) > Hn)} 

happen infinitely often. But, if Rjk(n) ^ k{n), then certainly Rjk{n) ^ k{jk{n)). 
Thus, in fact the events 

{3j > k{n) with Rj > k{j)} 
happen infinitely often. That is 

Qe[Rn > k{c,n)i. o. ] = 1. 
We conclude that C < R{X). □ 

6. Linear estimators work when u„ are not squcire-summable. Be- 
fore stating and proving a generalization of Theorem 1.2, we indicate how a weak 
form of that theorem may be derived by rather soft considerations; these moti- 
vated the more concrete arguments in our proof of Theorem 6.1 below. In the 
setting of Theorem 1.2, let 

^ def UjXj 

It is not hard to verify that EgT^ = 9 and sup„Var0(7^) < oo. Since {Tn} 
is a bounded sequence in L'^{fjb0), it has an L^-weakly convergent subsequence. 
Because the limit T of this subsequence must be a tail function, T = 9 a.s. 
Finally, standard results of functional analysis imply that there exists a sequence 
of convex combinations of the estimators Tn that tends to 6 in L^d^g) and a.s. 

The disadvantage of this approach is that the convergent subsequence and the 
convex combinations used may depend on 9; thus the argument sketched above 
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only works for fixed 9. The proof of Theorem 6.1 below provides an explicit 
sequence of estimators not depending on 6. 

We return to the general setting described in Section 2. A collection ^ of 
bounded Borel functions on R is called a determining class if fi = v whenever 



The following theorem generalizes Theorem 1.2. 

Theorem 6.1. -(f X^fe^o^fe ~ '-^> then for any hounded Borel function ip, 
there exists a sequence of functions /ijv : R''^ R with the following property: 

for any probability measure r] on R, we have 

h^iXi, . . . ,Xj^) — > / tpdrj a.s. with respect to . 



Thus the assumptions of the theorem imply that for any countable determining 
class ^ of bounded Borel functions on R, a.s. all the integrals {/ V'c^Jjjve* can 
be computed from the observations X, and hence a.s. the measure r] can be 

reconstructed from the observations. 

Proof. Fix ^ e 4*, and assume for now that «(■)/') = /r^'^ck = 0. Without loss 
of generality, assume that || V' II oo < 1- Define 



Let {cj} be any sequence of positive numbers. We will inductively define 
{mi}, {ui} with mi < Ui, so that 

(6.50) w{mi, Ui) > w{mi) for all i, and Cov(Li, Lj) < Ci for all j > i ■ 



ipdfi = J-^ tpdi' for all -0 e ^I*. 



n 



n 




For each pair mj < Ui, let 
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We now show how to define (rnj+i, rii+i), given m, so that (6.50) is satisfied. 
Observe that 

f^OV{Li,L^) — — 

w{mi,ni)w{mt,ni) 

(6.51) = , '^y' r u.u.-k-ul]. 

Fix k, and write m, n for me,ne respectively. We claim that 

n 

(6.52) ^ UsUs-k -ul < k. 

m+l 

Assume that X^m+i UsUs-k — u1 > Q; if not (6.52) is trivial. Applying the in- 
equality a — b < (a^ — 6^)/6, valid for b < a, yields 

(6.53) > UsUs-k-u^< . 

Then applying Cauchy-Schwarz to the right-hand side of (6.53) bounds it by 

w(m,n)w(m — k,n — k) — w(m,n)'^ , 

r < w\m — k, n) — wlm, n) 

w{m, n) 

= w{m — k,m) 
< k, 

establishing (6.52). Using the bound (6.52) in (6.51), and recalling that \ip\ < 1, 
yields 

(6.54) Co^{Li,U)<— y ulk< 



w{mi,rn)w{mi,ni) ^ w{me,ne) 



Pick mj_)_i large enough so that 



(6.55) w(mj+i) > — 



def 

and let rij+i = 'mi{t : w(TO,+i,i) > w(TOi+i)}. Then for any ^ > i -|- 1, since 
w{me,ne) > w{me) > w{mi+i), (6.55) and (6.54) yield that Cov{Li,L() < e^. 
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Observe that E[Li] = r]{ip), and 
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E 



i i=mi+l 



rii ni 



J— m^ + l k—j-\-l 
j=mi+l 



< II 11^ "I 2 Y ■"i X] UkUk-j +w{m^,n^)^ . 

j=mi + l k=j+l 



(6.56) 

Fix i, let m = mi,n = rij. For j fixed, using Cauchy-Schwarz yields 

" / 

(6.57) Y '^kUk-j < yw{j,n)wn-j < 



Wr,. ■ 



Plugging (6.57) into (6.56), and recalling that || II oo < 1, gives that 



(6.58) 



Thus, 



E 



J2 ^M^j) 



< 2<^ + Wn, . 



IH < B . 



Choosing, for example, ei = i ^, one can apply the strong law for weakly corre- 
lated random variables (see Theorem A in section 37 of [19]), to get that 



(6.59) 



1 . 

G„(^)='-^i.(V)-r7(V') a. s. 



For general ip, define Hn{ijj) = Gn{tp — oi{ip)) + a(V'). Prom (6.59), it follows that 



(6.60) 



def 

To finish the proof, define hN{Xi, . . . ,Xn) = Hk(N){'^)-, where k{N) is the 
largest integer k such that nk < N. □ 
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7. Quenched Large Deviations Criterion. Recall that p„ 



, the 



density of the measure /x^ restricted to Qn with respect to the measure /i^ re- 
stricted to Gn- 



We make the additional assumption that 
(7.61) 



f ( ^\ da = f — 



dri < 00. 



For two binary sequences 6, S', define J{S, S') = \{n : 6n = = the number 
of joint renewals. 

Lemma 7.1. //E[r-^('^'^') | A] < oo, then /u,, < /Xa. 



Proof. Let x{y, z, d)n = ZnS„ + y„{l - (5„). We have 

(7.62) EqJp„(X) I A = 5] = J I pn{x{y,z,6))da'^{y)dr]^{z).. 



and expanding p„ shows that (7.62) equals 



(7.63) 



n 



^{x{y,z,S)i)5l + l-Sl 



dP{S')da°°{y)dr]°°{z). 



Using Fubini's Theorem and the independence of coordinates under product 



measure, (7.63) is equal to 

dr] 



(7.64) 
If 



'ML 



da 



{x{y,z,6)i)6l + l-dl 



da{y)dri{z)dP{6'). 



J dcf 



R JR 



^{x{y,z,6),)5[ + l-6[ 



da{y)dr]{z) , 



then we have that 



(7.65) 



if S' = 



[j^{z)drjiz)=riiS' = l,6, = l 
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Plugging (7.65) into (7.64), we get that 

EqJp„(X)|A = c5]= / l[r'^''^dPi6') 
-'^1=1 

< [ r^(^'*')rfP(5') 
Jr 

= Eir-^^^'^') \A = S]. 
Applying Fatou's Lemma, we infer that EQ^[/9(X) | A] < oo, whence 

Qr,[p{X)<00] = 1. 

The Lebesgue Decomposition (3.2) implies that /x^, <C /Xc,. □ 

8. Absence of Phase Transition in Almost Transient Case In this 
section, we apply the quenched moment generating function criterion established 
in the previous section. 

Let N[m, n] be the number of renewals in the interval [m, n], and write Nm = 
N[0,m]. Let Um = U{m) = EA/-„ = Er=o^fe- 

Lemma 8.1. For any integer A> 1, we have P[Nm > AeUm] < e.~^ . 

Proof. For A = 1, the inequality follows from Markov's inequality. Assume it 
holds for ^ — 1. On the event E that > (^ — l)eUm, define r as the time of 

the \{A - l)eC/™]"* renewal. Then 

F[Nm > AeUm I E] < P[Ar[T,m] > eUm\E\ < P[Ar„ > eC/„] < e'^ . 
Consequently, 

P[Ar„ > AeUJ^ < F[Nm > AeU^\E]e-^^-^^ < e"^. 

□ 
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Theorem 8.2. Suppose that the renewal probabilities {un} satisfy 

U{e'') = o{k / log k), 

and also Uk < C2k~^. Ifrj <C a and ^ G L'^{c(), then fin <C Ma- 

Proof. In this proof the probabihty space wiU always be T^, endowed with the 
product measure P^, where P is the renewal probability measure. Let 

J[m,n] = |{n < fc < m : Afc = A'j. = 1}| 

be the number of joint renewals in the interval [m, n]. 
First we show that 

(8.66) V C, Ti + ■ • • + Tfe > e'^'^ eventually. 

Observe that 

(8.67) P[Ti + • • • + Tfe < 6^*=] = P[iV(e^'=) > k] < exp . 

Our assumption guarantees that k/eU{e'~"') > 21ogfc eventually, and hence the 
right-hand side of (8.67) is summable. Consequently, for almost all A, there is 
an integer M = M(A) such that Ylj^i Tj > e'^^ for all k > M(A). Equivalently, 
A^[0, cxp(CA:)] < k when k > M. To use Lemma 7.1, it suffices to show that 

s"P[J[0,n] > n I A] < 00 a.s., for all real s. 

n 

We have 

oo 

(8.68) ^s"P[J[0,n] > n I A] < C2(A) + ^ s"P[J(e'^", oo) > 1 | A] 
Observe that 

oo 

(8.69) E[J(e^",(^)]= <<C^e-^^, 

fe=exp(Cn) 



Q{{xi,yi), {x2,y2)) = < 
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since we have assumed that u„ < C2n~^. Thus the expectation of the sum on 
the right in (8.68), for C large enough, is finite. Thus the sum is finite A-almost 
surely, so the conditions of Lemma 7.1 are satisfied. We conclude that /U^ <C /Ua- 

□ 

We now discuss examples of Markov chains which satisfy the hypothesis of 
Theorem 8.2. 

Lemma 8.3. Given two Markov chains with transition matrices P,P' on 
state spaces X and y with distinguished states xq, yo respectively, construct a new 
chain $ = {X, Y) on X xy with transition matrix 

P{xi,X2)P'{yi,y2) ifyi = 
P'{yi,y2) ifyi ^0, xi= X2 

Let A{s) = X^^]^ /nS" be the moment generating function for the distribution 
of the time of first return to xq for the chain with transitions P, and let B{s) 
be the corresponding generating function but for the chain P' and state yo . Then 
the generating function for the distribution of the time of the first return of $ to 
{xo,yo) is the composition Ao B. 

Proof. Let ^i, S2, ... be the times of successive visits of $ to x {yo}, and 
Tk = Sk — Sk-i- Observe that F is a Markov chain with transition matrix P' , 
so {Tk} has the distribution of return times to yo for the chain P' . 

Let r = inf{n > 1 : Xs^ = xq}. Note that {^s„}^o a Markov chain with 
transition matrix P, independent of {Tn}. Hence r is independent of {Tn}, and 

T = Ti + ---+Tr 

is the time of the first return of $ to (xo,yo)- A standard calculation (see, for 
example, XILl in [8]) yields that the generating function Es^ is Ao B. □ 
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Let F, U be the moment generating functions for the sequences {/„} and 
{un} respectively. Define L : (0, oo) (l,oo) by L{y) = 1 — i, and note that 
F = LoU. Denote W{y) = UoL{y) = L-'^oFoL. When F3 = F10F2, it follows 
that W3 = W"ioW2. 

We use the following Tauberian theorem from [16, Theorem 2.4.3]: 

Proposition 8.4. Let {a„} be a sequence of non-negative reals, A{s) = 
SS^o ^n*" generating function, W{y) =' A{1 — y^^), a > a constant, and £ 
a slowly varying function. The following are equivalent: 

(i) A{s) X (1 - s)-"£((l - s)-i) fors<l near 1. 

(ii) W{y) ^ y"i{y) for large y. 
(Hi) An = X^Lo >; n"^(n) • 

We now exhibit Markov chains with no phase transition. 

Proposition 8.5. There is a Markov chain that satisfies Un x log log n, 
and Un < Cn~^ . 

Proof. For simple random walk on Z^, we have 

00 

U{s) X J2 = - log(l - s^) . 

n=l 

Thus, W{y) X logy. Consequently, W o W{y) x loglog(y) corresponds to the 
chain in Lemma 8.3 with both P and P' the transition matrices for simple random 
walk on Z^. Proposition 8.4 implies that Un x log log n. Finally, 

Un < P[Xn = 0] < , 

since X is a simple random walk on Z^. □ 
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In conjunction with Theorem 8.2, this establishes Theorem 1.4. 
Lemma 8.3 can be appUed to construct Markov chains obeying the hypothe- 
ses of Proposition 4.1 and Theorem 5.1. Take as the chains X and Y the simple 
random walk on Z. The moment generating function U[i] for the return probabil- 
ities Un of the simple random walk is given by U[i]{s) = (1 — ,s^)^^/^ (see XIII. 4 
in [8]). Then W[^{y) = C/[i] o L{y) = {^^V/^ satisfies W^^{y) - {y/2y/^ as 
y — > 00. Hence W{y) = W^ij o >^ 2/^^^, and by Proposition 8.4, Un x n^/*. 

The last example is closely related to the work of Gerl in [9]. He considered 
certain "lexicographic spanning trees" 7^ in Z'', where the path from the origin 
to a lattice point {xi, . . . , xj) consists of at most d straight line segments, going 
through the points (xi, . . . , Xfe, 0, . . . , 0) for k = 1, . . . , d in order. Gerl showed 
that for > 2, the return probabilities of simple random walk on 7^ satisfy 
U2n ^ n'^ \ after introducing delays, this provides further examples of Markov 
chains with a phase transition (0 <9c < 1). 

9. Absence of Phase Transition in TP'. The results in [10] (as summa- 
rized in Theorem B of Section 1) show that for simple random walk on Z^, 
which moves in each step to a uniformly chosen neighbor, the measures jjLg and 
Ho are mutually absolutely continuous for all 9. The argument does not extend 
to Markov chains which are small perturbations of this walk. For example, if 
the walk is allowed to remain at its current position with some probability, the 
asymptotic behavior of is not altered, but Theorem B does not resolve 
whether jiQ <^ /io always. In this section, we show that for any Markov chain 
with return probabilities that satisfy u„ = 0{n~^), the measures He and /Uq are 
mutually absolutely continuous. 
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Recall that T is the time of the first renewal, and Ti, T2, . . . are i.i.d. copies of 
T. Also, Sn = X^"=i denotes the time of the n*^ renewal. Recall from before 
that An is the indicator of a renewal at time n, hence 

{Sn = k for some n > 1} = {A^ = 1} . 

Let S'n and denote the renewal times and intcr-rcncwal times of another 
independent renewal process. Recall that J is the total number of simultaneous 
renewals: J = X^^Lg ^^^fe- ^^^k is the sigma-field generated by {Tj : 1 < j < k}, 
then define 

(9.70) g„ = P[J > n I A] = P[ I ■.Si = S'^}\ > n\s. 
In this section, we prove the following: 

Theorem 9.1. When Un = 0{n~^), the sequence {qn} defined in (9.70) 
decays faster than exponentially almost surely, that is, 

logg„ — > —00 almost surely. 

Consequently, the quenched large deviations criterion Lemma 7.1 implies that if 
ri a and ^ € L'^{a), then fj,n <C /Xa- 

We start by observing that the assumption u„ < ci/n implies a bound for 
tails of the inter-renewal times: 

(9.71) 3c2>0 P[logT>t]>C2t-\ 
Indeed, by considering the last renewal before time (1 + a)n, 

(l+o)n-l 

1= ^ UkP[T > {1 + a)n - k] 
fe=o 
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an (l+a)n 

<^UfeP[T>n]+ "fc 

fe=0 fe=an+l 

< (2 + ci log an)P[T >n]+ 2ci log 



Choosing a large yields (9.71). 

Let u}{n) be any function going to infinity, and denote 

m(n) := nlogna;^(n) . 

Below, we will often write simply m for m{n). 
From (9.71) it follows that 

P[Smin) < e"'^(")] < (1 - ^-^) < n-'=-(" 
^ ' \ mj[n)J 

This is summable, so by Borel-Cantelli, 

(9.72) n-^log5„(„) ^00 

almost surely. 

Proof of Theorem 9.1. Define the random variables 



Jm =^ \{{h3) ■ i > m,j > 1 and Si = S'. }| 



and let Q„ =^P[J„ > 1 | Soo] ■ 
Let 

r„ =■ P[ I {(z,j) : i < m{n) and Si = S'j} \ > n 

Clearly, 

(9.73) qn < Qm(n) + Tn ■ 
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Write Q*^ = E[0„ | S^] = P[Jm > 1 | ^m] • Then 

oo 

Qm(n) ^ E[J„(„) I 5„(„)] < y^MfcMfc+S„(„, 

fe=l 

Ci Ci log 

< y < C3 ^ . 

fe=l ^ ^ 'S'm(n) 

By (9.72), we see that ^°sQm{n) ~^ almost surely. 

Since Q;^(„) = nQm(n)\Smin)], we see that P[Q„(„) > 2^Q*^^^^] < 2"", 
hence 

Qm{n) > 2"<3™(„) finitely often 

and it follows that log Qm(n) ~* ~oo- It therefore suffices by (9.73) to show 
that 

(9.74) — > —00 almost surely. 

Let [m(n)] = {1,2,..., m(n)}. We can bound r„ above by 

(9.75) ^ P[Vi e A, 3j > 1 so that S'^ =5^1500] < ("^^^A i?„ , 



AC[m(n)] 
|A|=n 



where 



ii„ =^ max P[Vi e A, 3j > 1 so that 5- = 5^ I 5oo ] . 

\A\=n 

We can conclude that 

(9.76) logr„ < log (^""^"^^ + logi?„ . 

Notice that ("^")) = eO("'°siogn) ^j^^^^ j^Qj.g ^^an polylog n; for 

convenience, we assume throughout that a;^(n) = o(logn). Hence, if we can 
show that 

(9.77) og^w ^ almost surely, 

n log log n 
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then by (9.76), it must be that (9.74) holds. 

For any n-element set A c [m(n)], we use the following notation: 

• A = {xi < X2 < ■ ■ ■ < Xn}, and m''= Xn- 

• For any k < m', let I{k) be the set of indices i such that {Ti\i^i{k) are the 
k largest inter-renewal times among {Tj}j<TO/. 

• For i <n, let M{A, i) maxjT,- : Xi-i + 1 < j < a;,}. 
We have 

n 

V[\/Xi e A, 3j > 1 so that S'j = S^, \ S^] = H us^^-s.^_^ , 

where a;o = and 5*0 =*0. Recalling that u„ < ci/n, we may bound the right- 
hand side above by 

n n n 

C\ TT Ci ^>^^^dcf^-^ C\ 



(9.79) i?„ < max RiA) = max TT ttti"^ • 

ylC[m(n)] AC[m(n)] -"--^ M(^, l) 

141—^ \A\—„ »=1 



To summarize, we have 

n 

C\ 

|A|=n |A|=n 

To see where this is going, compute what happens when A= [n] . From the tail 

behavior of T, we know that 

. , log i?([n]) „ 
liminf — ^ > 0. 

n^cx) n log n 

To establish (9.77), wc need something like this for i?„ instead of i?([n]). 
In what follows, ko{n) =' 10(logna;(n))^. 

Lemma 9.2. Almost surely, there is some (random) N so that if n > N, 
then for all n-element sets A C [rn(n)], providing k satisfies m' > k > ko{n), at 
least fcn/(6m'loglogn) values ofi satisfy M{A,i) e {Tj : j s I{k)}. 
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Assuming this for the moment, we finish the proof of the theorem. The fol- 
lowing summation by parts principle will be needed. 

Lemma 9.3. Let H{k) he the k largest values in a given finite set H of 
positive real numbers. Suppose another set H' contains at least ek members of 
H{k) for every ko < k < \H\. Then 



Proof of Lemma 9.3. Let H ~ {hj,j = 1, ■■■,N} in decreasing order and 
let Hn+i = for convenience. Write 




h. 



heH' 



heH\H{ko) 



m = Mh.eH'} , and let F{k) = /(I) + ... + f{k) . 



Then 



N N N 




> E F{k){hk - hk+i) > E <^k{hk-hk+i) 





= e 




h 



heH\H{ko) 



This proves the lemma. 



□ 



Lemma 9.4. Write {Ti}. 



n 



in decreasing order: 



^(1) > ^(2) > • • • > T'(m) • 



Then 
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Proof. It suffices to prove this lemma in the case where >c n~^, because 
in the case where u„ < cn~^, the random variables Tj stochastically dominate 
those in the first case. 

def 

Let Yi = logTj; then Yi are i.i.d. random variables with tails obeying 



Write y(j) for the « largest among From [5], it can be seen that 

, Ao(") \ 

(9.80) lim — V Yu-. - n log log n =0. 

ra^oo n log n \ ^ ' j 

From Theorem 1 of [20], we can deduce that 

1 " 

(9.81) lim inf — V Yu^ > . 

n^oo n log n 

Combining (9.80) and (9.81) yields 

1 " 

lim inf— V Yu) > . 

n— ►oo n log n ^ — ' 

□ 



Recall that 

n 

R{A) ^Y[cM{A,i)-K 

i=l 

From Lemma 9.2 we see that almost surely there exists an N so that, for all 
n > N and fco(n) < k < m' the set {M{A,i) : 1 < i < n} includes at least 
fcn/(6m'loglogn) of the k greatest values of {Tj}^^ Therefore by Lemma 9.3 
(applied to the logs of the denominators), we see that for n > iV and all A c 
[m(n)], 

(n/m') Y:T=ko{n)+i log(7^(i)/c) 



-logi?(^) > 



(6 log log n) 



40 D.A. Levin, R. Pemantle, and Y. Peres 

Since (m'logm')"^ J27^ko{n)+i ^'^s{Ti/c) has a nonzero liminf by Lemma 9.4, we 
see that log log n |^^g ^ is not going to zero, from which follow (9.77) and the 
theorem. □ 

It remains to prove Lemma 9.2. Define the event Gn,m' to be the event 

for all n-element sets A c [^(n)] with maximal element m', and k 
obeying m' > k > ko{n), at least A;n/(6m'loglogn) values of i satisfy 

M{A,i) e {Ti : iel{k)}. 
Then de&ne Gr,":^' nZtiG 

n.m' • The conclusion of Lemma 9.2 is that 

(9.82) P[G„ eventually] = 1. 
If we can show that 

(9.83) PK,„'] < n-', 

then by summing over m' € [n, m(n)], we can conclude that P[GJi] < '"S'^ (") ^ 
and hence by Borel-Cantelli, that (9.82) holds. 

We prove (9.83) for m' = m, the argument for other values of m being identi- 
cal. The values Ti,T2, . . . are exchangeable, so the set I{k) is a uniform random 
fc-element subset of [m] and we may restate (9.83) (with m' = m): 

Let 

I{k) = {ri < r2 < • • • < Tfe} 

be a uniform A;-subset of [m(n)]; then the event Gn,m has the same probability 
as the event G„ defined as 
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for all n-element sets A = {xi < ■ ■ < Xn = m} C [m] and k 
satisfying m > k > ko{n) , a,t least fcn/(6mloglogn) of the intervals 
[xi-i + l,Xi\ contain an element of I{k). 

Equivalently, Gn,m is the event that 

for all n-element sets A = {xi < ■ ■ ■ < Xn = m} C [m] and 
k satisfying k > fco(n), at least fcn/(6TOloglogn) of the intervals 
[vi, Vi+i — < i < k contains an element of A. 

Finally, Gn,m can be rewritten again as the event 

for k obeying m > k > ko (n) , no kn/ {6m log log n) — 1 of the intervals 
[ri,rj+i — 1] together contain n points. 

Proving the inequality (9.83) is then the same as proving that 

(9.84) F[Gn,m] > l-n-\ 

def 

For < j < A; let Dj denote r^+i — Vj where ro := and rk+i = m+1. For any 

B C [k], let W{B) denote the sum J2jeB Then define the events Gn,m,k to 
be 

For all sets B c [k] with |B| < fcn/(m log log n), we have W{B) < n. 

We have that G„,„ = ^'^=ko(n)+i^n,m,k- 

Set e = n/m = (logna;^(n))~^, and set S = e/(61oglogn), so that 

,iog^ = lMV!)<?! 

S 6 log log n 5 
for sufficiently large n. We now need to use the following lemma: 

Lemma 9.5. Let p{k, m, e, S) denote the probability that there is some set B 
of cardinality at most 6k such that W{B) > em. Then for e sufficiently small and 
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51og(l/<5) <e/5, 

p{k,m, e,5) < e''''/'^. 

The proof of this will be provided later. 

Now applying Lemma 9.5, we have that for fixed k so that m> k > ko{n), 

since ^ > n~^. Summing over k gives that 

F[Gn,m] > l-n-^ 

To prove Lemma 9.5, two more lemmas are required. 

Lemma 9.6. Let B C [fc] and W := Y.jeB ^j- Then /or < A < 1, 

/ 1 

(9.85) EgAfeiy/m < I __ \ 

Proof. The collection {Dj : < j < A;} is exchangeable and is stochas- 
tically increasing in m. It follows that the conditional joint distribution of any 
subset of these given the others is stochastically decreasing in the values condi- 
tioned on, and hence that for any B C [k], and A > 0, 



(9.86) Eexp ^£>j 1 < Eexp{Dj) = (Eexp(£)o)) 



The distribution of Dq is explicitly described by 



P(Z,„>„ = ,l_i.,^.,(,-_^). 



Thus 



\B\ 
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In other words, kDa/m is stochastically dominated by an exponential of mean 1, 
leading to -Ee^kDo/m < 1/(1 _ A). Thus by (9.86), Eexp{XkW/m) < (l-A)"!^', 
proving the lemma. □ 

Lemma 9.7. Let \B\ = j and let W = J2jeB previous lemma. 

Then 

Proof. Use Markov's inequality 

m ~ k ~ e-^* 
Set X = 1 — j/t and use the previous lemma to get 

P(}I>i)<(l_A)-^e-^* 
m k 



t^' 



proving the lemma. □ 



Proof of Lemma 9.5. We can assume without loss of generality that j := 
6k is an integer and that n := em is an integer. By exchangeability, p{k, to, e, 6) 
is at most C^j^^) times the probability that W{B)/m > e for any particular B of 
cardinality j. Setting t = ke and plugging in the result of Lemma 9.7 then gives 



p{k, TO, e. 




44 D.A. Levin, R. Pemantle, and Y. Peres 

The inequality (l) < {a/bf{a/{a - b))"-^ holds for all integers a > 6 > (with 
0° := 1) and leads to the right-hand side of the previous equation being bounded 
above by 

Hence p{k, m, e, 5) < e''^^'^'^^ where 

r(e, 6) = (5(log e - 2 log 5 + log(l - Sj) - log(l - S) + S - e. 

Since loge and log(l — 6) are negative, we have 

r(e, S) < 2S\og{l/S) -e + S + log(l/(l - S)). 

For sufficiently small e, hence small 6, we have 5+log(l/(l— 5)) < (l/2)(51og(l/(5), 
hence 

r(e, S) < (5/2)^ log(l/^) - e < e/2 - e = - | , 
by the choice of 6. This finishes the proof. □ 

10. Concluding Remarks. • A Markov chain F with state-space <Y and tran- 
sition kernel P is transitive if, for each pair of states x,y € X, there is an in- 
vertible mapping ^ : X ^ X so that $(a;) = y, and P{y,^{z)) = P{x,z) for 
all z €: X. Random walks, for example, are transitive Markov chains. When the 
underlying Markov chain F is transitive, our model has an equivalent percolation 
description. Indeed, given the sample path {r„}, connect two vertices m,£ d Z+ 
iff 

F„ = F^ , but Tj F„ for m < j < £. 

A coin is chosen for each cluster (connected component), and labels are generated 
at each a; G Z+ by flipping this coin. The coin used for vertices in the cluster of 
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the origin is ^-biased, while the coin used in all other clusters is fair. The bonds 
are hidden from an observer, who must decide which coin was used for the cluster 
of the origin. For certain T (e.g., for the random walks considered in Section 4), 
there is a phase transition: for 9 sufficiently small, it cannot be determined which 
coin was used for the cluster of the origin, while for 6 large enough, the viewer 
can distinguish. This is an example of a 1- dimensional, long-range, dependent 
percolation model which exhibits a phase transition. Other 1-dimensional models 
that exhibit a phase transition were studied by Aizenman, Chayes, Chayes, and 
Newman in [2]. 

• In Sections 4 and 8, wc constructed explicitly renewal processes whose renewal 
probabilities {«„} have prescribed asymptotics. Alternatively, we could invoke 
the following general result. 

Kaluza's Theorem [14]. //u(0) = 1 and u{k - l)u{k + 1) > u^ik) for k>l, 
then {uh} is a renewal sequence. 

See [14] or [1, Theorem 5.3.2] for a proof, and [18] for a generalization. 

• An extended version of the random coin tossing model, when the underlying 
Markov chain is simple random walk on Z, is studied in [17]. Each vertex z €Z 
is assigned a coin with bias 9{z). At each move of a random walk on Z, the coin 
attached to the walk's position is tossed. In [17], it is shown that i{\{z : 9{z) ^ 0}| 
is finite, then the biases 9{z) can be recovered up to a symmetry of Z. 

Some unsolved problems. Recall that A and A' denote two independent and 
identically distributed renewal processes, and Un = P[A„ = 1]. The distribution 
of the sequence of coin tosses, when a coin with bias 9 is used at renewal times, 
is denoted by hq. 

1. Is the quenched moment generating function criterion in Lemma 7.1 sharp? 
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That is, does E[r^"=o'^"'^'' | A] = oo for some r < 1 + 9"^ imply that 
IJ-e -L Mo? 

2. Does _L hq imply that fiOi -L ^612 for all 62 0x1 

3. For renewal sequences exhibiting a phase transition at a critical parameter 
9c, is He, -L /xo? 

Acknowledgments. We thank A. Dcmbo, J. Steif, and O. Zeitouni for 
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